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Abstract — Irregular low-density parity check (LDPC) codes are 
particularly well-suited for transmission schemes that require 
unequal error protection (UEP) of the transmitted data due to the 
different connection degrees of its variable nodes. However, this 
UEP capability is strongly dependent on the connection profile 
among the protection classes. This paper applies a multi-edge 
type analysis of LDPC codes for optimizing such connection 
profile according to the performance requirements of each 
protection class. This allows the construction of UEP-LDPC codes 
where the difference between the performance of the protection 
classes can be adjusted and with an UEP capability that does 
not vanish as the number of decoding iterations grows. 

I. Introduction 

I In communication systems where source bits with different 
' sensitivities to errors are being transmitted, it is often wasteful 
or even infeasible to provide uniform protection for the whole 
data stream. In this scenario, the common strategy is the use 
of schemes with unequal error protection (UEP) capabilities. 
There are mainly three strategies to achieve UEP on trans- 
, mission systems: bit loading, multilevel coded modulation, 
' and channel coding In this paper, we will focus on the 
latter, more specifically on low-density parity-check (LDPC) 
codes that provide inherent unequal error protection within a 
codeword. 

Irregular LDPC codes [2J can inherently provide unequal 
error protection due to the different connection degrees of 
the coded bits. The connection degrees of the variable and 
check nodes of such codes are defined by the polynomials 

H^) = Z]j=2°" ^ix''^ and p{x) = I]i=2°" where 
dy^^^ and dc^^^ are the maximum variable and check node 
degrees of the code. From now on, we will refer to irregular 
LDPC codes where the variable nodes are divided into disjoint 
sets called protection classes as unequal error protection LDPC 
codes (UEP-LDPC). 

A flexible optimization of the irregularity profile of irregular 
LDPC codes based on a hierarchical optimization of the 
variable node degree distribution was proposed in |3|, where 
the authors interpret the UEP properties of an LDPC code 
as different local convergence speeds, i.e., the most protected 
bits are assigned to the bits in the codeword which converge 
to their right value in the smallest number of iterations. This 
assumption is made in order to cope with the observation that 
the UEP gradation vanishes as the number of iterations grow. 



a fact also observed in (4). In (5], the authors observed that 
this vanishing UEP gradation of an iteratively decoded LDPC 
code is dependent on the algorithm used to construct the parity 
check matrix, and suggested that the connectivity between the 
classes is the key factor to be observed if the UEP capabilities 
should be held as the number of iterations grows. 

Herein, we propose an optimization algorithm for the con- 
nectivity profile between the different protection classes of 
LDPC codes in order to not only keep the UEP capability of 
a code for a moderate to large number of decoding iterations, 
but also to adjust the performance of the protection classes 
as required for different applications. This is achieved by 
means of a multi-edge type (MET) analysis |j6|, Q of the 
LDPC codes. The multi-edge analysis enables us to distinguish 
between the messages exchanged during the iterative decoding 
among the different protection classes within one codeword. 
Thus, we can control the amount of information that the most 
protected classes receive from the less protected ones and vice 
versa. If the most protected classes receive a lot of information 
from the less protected ones, its performance will be decreased 
while the one of the less protected classes will be enhanced. 
Our main goal is to show how this exchange of performance 
among the protection classes can be controlled and optimized. 

This paper is organized as follows. In Section II, we 
describe the multi-edge type analysis of UEP-LDPC codes. 
Section III discusses the asymptotic analysis of multi-edge 
type UEP-LDPC codes and the optimization algorithm used 
to optimize the connection profile between the protection 
classes. In Section IV, we show the results of the developed 
optimization method for a chosen example. Finally, some 
concluding remarks are drawn in Section V. 

II. Multi-Edge type Unequal Error Protection 
LDPC Codes 

A. Multi-edge LDPC codes 

Multi-edge type LDPC codes [6| are a generalization of 
irregular and regular LDPC codes. Diverting from standard 
LDPC ensembles where the graph connectivity is constrained 
only by the node degrees, in the multi-edge setting, several 
edge classes can be defined and every node is characterized 
by the number of connections to edges of each class. Within 
this framework, the code ensemble can be specified through 



two multinomials associated to variable and check nodes. The 
two multinomials are defined by lUj 



L(r,x) = ^Lb4r''x'', 
i?(x) = ^dx", 



(1) 



(2) 



where b, d, r, and x are vectors which are explained as follows. 
First, let nie denote the number of edge types used to represent 
the graph ensemble and the number of different received 
distributions. The number represents the fact that the 
different bits can go through different channels and thus, have 
different received distributions. Each node in the ensemble 
graph has associated to it a vector x = {xi, Xm^) that 
indicates the different types of edges connected to it, and a 
vector d — (di, referred to as edge degree vector 
which denotes the number of connections of a node to edges 
of type i, where i e (1, . . . , m^). 

For the variable nodes, there is additionally the vector 
r = (ri, r™,,) which represents the different received dis- 
tributionfl and the vector b = (6o, ^m^) that indicates the 
number of connections to the different received distributions 
(bo is used to indicate the puncturing of a variable node). In the 
sequel, we assume that b has exactly one entry set to 1 and the 
rest set to zero. This simply indicates that each variable node 
has access to only one channel observation at a time. We use 
x*" to denote YVu^i ^i' ™d i"*" denote HIILo '^i ' ■ Finally, the 
coefficients Lb.a and are non-negative reals that represent 
the fraction of variable nodes of type (b,d) and check nodes 
of type (d) within a codeword, respectively. Furthermore, we 
have the additional notations defined in ITJ 

dL{r,x) 



Lr, (r, x) = 



dr, 
dL{r,x) 

dxi 
dR(x) 
dxi 



(3) 



(4) 



(5) 



Note that in a valid multi-edge ensemble, the number of 
connections of each edge type should be the same at both 
variable and check nodes sides. This gives rise to the socket 
count equality constraint which can be written as 



1, 



(6) 



where 1 denotes a vector with all entries equal to 1, with 
length being clear from the context. 

Unequal error protection LDPC codes can be included in 
a multi-edge framework in a straightforward way. This can 
be done by distinguishing between the edges connected to 
different protection classes within a codeword. According to 
this strategy, the edges connected to variable nodes within a 

'in the multi-edge framework, one can consider that the different variable 
node types may have different received distributions, i.e., the associated bits 
may be transmitted through different channels. In this work, we consider 
that the variable nodes have access solely to one observation and that the 
transmission is made through an AWGN channel. 




Fig. 1. Multi-edge graph with two different edge types and one received 
distribution. 



protection class are all of the same type. For example, in Fig. 
[T]the first 4 variable nodes can be seen as one protection class 
since they are connected only to type 1 edges (depicted by 
solid lines), and the last 3 variable nodes compound another 
protection class, since they are only connected to type 2 edges 
(depicted by the dashed lines). It is worth noting that opposed 
to the variable nodes, the check nodes admit connections with 
edges of different types simultaneously as can be inferred 
from FiglT] In the following, we will divide the variable nodes 
into nie protection classes (Ci , C2 , . . . , C™^ ) with degrading 
levels of protection. 

B. Edge perspective notation 

The connection between the protection classes occurs 
through the check nodes since they can have different types 
of edges attached to them. Consider irregular LDPC codes 
with node perspective variable and check node multi-edge 
multinomials L{r,x) — ^ Lb,dr"'x'* and i?(x) ~ ^ i?dx'*, 
respectively. 

In order to implement the optimization algorithm, it will 
be more convenient to work with the edge, instead of the 
node perspective. We now define edge perspective multi- 
edge multinomials. Let p'^^ denote the fraction of type j 
( j ~ 1, • ■ • , me) edges connected to check nodes of type d. 
The fraction p^^^ is calculated with respect to the total number 
of edges of type j and is thus given by 



djR{i 



(7) 



Similarly, let X^^ denote the fraction (computed with respect 
to the total number of type j edges) of type j edges connected 
to variable nodes of degree i. This gives us the following edge 
perspective multinomial 



(8) 



where X] represents the fraction of class j edges connected 
to variable nodes with degree i. In the next section, we will use 
Eqs. ^ and dS) in the derivation of the optimization algorithm 
for the connection profile among the protection classes of an 
UEP-LDPC code. 



III. Check node profile optimization 

A. Asymptotic Analysis 

Our main objective is, given the overall variable and check 
node degree distributions of an UEP-LDPC code, to optimize 
the connection profiles between the different protection classes 
in order to control the amount of protection of each class while 
preserving the UEP capability of the code after a moderate to 
high number of decoding iterations. In order to simplify the 
optimization algorithm, we suppose that the LDPC code to be 
optimized is check-regular, i.e., all the check nodes have the 
same degree. 

Despite of having the same degree, each check node may 
have a different number of edges belonging to each one of 
the me classes. Consider for example a check node with an 
associated edge degree vector d = (di,d2, • • • ,dm^), where 
di is the number of connections to the protection class i and 
S"=i — dcman: ' '^^ ^hcn considcr a code with ra^ — 3 
protection classes, each check node may be connected to di 
edges of class 1, d2 edges of class 2, and d-^ edges of class 
3. This posed, one can compute the evolution of the iterative 
decoding by means of density evolution. 

We assume here standard belief propagation decoding of 
LDPC codes where the messages exchanged between the 
variable and check nodes are log-likelihood ratios having a 
symmetric Gaussian distribution (variance equals twice the 
mean). Before dealing with the subtle case of irregular multi- 
edge type LDPC codes, let's make for now two simplifying 
assumptions: 1) All variable nodes have the same degree d^. 
2) All check nodes have the same edge degree vector d. 

Under these assumptions, we can generalize the results 
obtained in |8| for regular LDPC codes and compute the 
mutual information between the output message of a class 
Cj, degree-(i„ variable node and the observed channel valu^ 
at iteration /, which is given by 



(^^4/a2 + K-i)[j-i(/f;/_,)]2^, 



(9) 



where is the channel noise variance, is the mutual 

information received from the neighboring check nodes at 
iteration I — 1 and the J(.) function is defined as in |,9J 



J{a) 



27rcr 



•log2[l + e-«]dC 



(10) 



Similarly, the mutual information sent to the variable nodes of 
class Cj from a check node with an associated vector d can 
be expressed as 



- J 



/(d,-l)(J-l(l-cj))2 + ^ 



(11) 



^For the sake of simplicity, through the rest of text we will simply speak 
of "mutual information of some variable" when we refer to the mutual 
information between this variable and its observation thi'ough the channel. 



Let's now deal with the more general case of irregular 
codes. For irregular codes, the incoming densities to a node 
are not necessarily equal due to varying degrees. Therefore, 
the overall mutual information at the output of the variable 
and check nodes is averaged over the different degrees. Also 
note that, in the irregular case, for optimizing the connection 
profile between the protection classes, we need to consider 
the case where check nodes with different edge degree vector 
d are allowed. This posed, the mutual information between 
the received channel values and the messages sent from the 
check to variable nodes and from variable to check nodes at 
iteration / within the protection class Cj, computed by means 
of density evolution using the Gaussian approximation ifTOll . 
are given by 



-"J 



E 

i=2 



(12) 



1^1 = 1 - 



E E 

s— 1 d:dj—s 



■ J 



l{d, 1) J-l(l - + ^ J-l(l - I^^ 



(13) 

Combining Eqs. ( fT2] i and (fTJI i, one can summarize the 
density evolution as a function of the mutual information of the 
previous iteration, the mutual information contribution from 
the other classes, noise variance, and degree distributions 



(14) 



where i £ (1, . . . , rrie) and i ^ j. By means of Eq. ( fT4b . we 
can predict the convergence behavior of the decoding and than 
optimize the degree distribution p^' under the constraint that 
the mutual information shall be increasing as the number of 
iterations grow, i.e.. 



F(A(-'')(a 



5 Pd ' " ■ 



(15) 



At this point, it is worth noting that, as pointed out in f4l 
and the UEP capabilities of a code depend on the amount 
of connection among the protection classes, i.e., if the most 
protected class is well connected to the least protected one, the 
performance of the former will decrease while the performance 
of the latter will be improved. For example, suppose a code 
with 2 protection classes and dc^^^ = 4. The possible values 
for d = (di,d2) are (0,4), (l,3r(2,2), (3,1), and (4,0). On 
the one hand, if a code has a majority of check nodes with 
d = (4, 0), the first protection class will be very isolated from 
class 2 which will lead to an enhanced performance difference 
between the two classes. On the other hand, if a large amount 
of the check nodes are of type d — (2, 2), one can expect 
the protection classes to be very connected, which favors the 
overall performance but mitigates the UEP capability of a code 
at a moderate to large number of decoding iterations. This 



indicates that for controlling the UEP capability of an LDPC 
code and to prevent this characteristic from vanishing as the 
number of decoding iterations grows, one has to control the 
amount of check nodes of each type, i.e., optimize . 

B. Optimization Algorithm 

The algorithm described here aims at optimizing the connec- 
tion profile between the various protection classes present on 
a UEP-LDPC code, i.e., p"^' . Initially, the algorithm computes 
the variable node degree distribution of each class \'^^^{x) 
based on \{x), dc,„„x' the number of edges on each 
class. The algorithm then proceeds sequentially optimizing the 
connection profile to the check nodes of one class at a time, 
proceeding from the less protected class to the most protected 
one. This scheduling is done in order to control the amount of 
messages coming up from the less protected classes that are 
forwarded to the more protected ones. 

Since we are using linear programming (LP) with only a 
single objective function, we chose it to be the minimization 
of the average check node degree within the class being 
optimized, i.e., it minimizes the average number of edges of 
such a class connected to the check nodes. This minimization 
aims at diminishing the amount of unreliable messages (i.e., 
the ones coming up from the less protected variable nodes) that 
flows through a check node. In addition to it, we control the 
proportion of check nodes of type d introducing the parameter 
maxp'^^ which is an upper bound on X^d d =s /^d^' i-^-' 
limits the proportion of check nodes of type d : dj — s for s — 
0, . . . ,dc , thus regulating the degree of connection among 

max 

the protection classes. For example, setting maxp^ — 0.35 
means that the maximum fraction of check nodes with edge 
degree vector d (for any d) will be 0.35. 

The optimization is then performed for each class Cj by 
minimizing its average check node degree for a decreasing 
^min from dc,„ax to 1' where is the minimum number 

of edges of class j connected to a check node. At this point, 
one can argue that since our goal is to minimize the average 
connection degree within a protection class, we should thus 
set (i^^„ — 1. The problem with this strategy is that it 
would shorten the degree of freedom for the optimization of 
the next class, e.g., suppose the optimization of a two-class 
code with = 3 and dc„^^^ = 5. Once we proceed to 

"^'^^ (2) (2) 

the optimization of class two, the coefficients 3)' '"(14)' 

and P(o 5) '^^^ determined and consequently fixed for the next 
optimization step, i.e., the optimization of class 1, we will 

have as variables only the coefficients p\^^\y P^j^iy and p|5''o)- 

(2) ' ' ' 
Note that in this case, if we had set = 1, there will be no 

degree of freedom for optimizing class 1 since the only non- 
optimized d would be d = (5, 0) which would be determined 
by J2&dj=s Pd^ = 1' i-^-' the sum of all fraction of 

edges must be equal to one. 

The iterative procedure is successful, when a solution p'^^ 
is found which converges for the given and (i^|„ > 0. We 
assume that the optimizations for classes {Cj',j' < j} have 



already been performed and the results of these optimizations 
are used as constraints in the current optimization process. The 
optimization algorithm can be written, for given A(x), a^, rrie, 
dc^^^, and maxp^J^ for j — 1, . . . , nie as shown in Fig. |2] 



Fig. 2. Check node profile optimization algoritlim. 

Note that the optimization can be solved by linear program- 
ming since the cost function and the constraints (Ci), (C2), and 

(i) 

(C3) are linear in the parameters p^^'. The constraint (C4) is 
the previous optimization constraint. Once we have optimized 
the check node profile, the code can be realized through the 
construction of a parity check matrix following the desired 
profile. 

IV. Simulation Results 

In this section, simulation results for multi-edge type UEP- 
LDPC codes with optimized check node connection profile are 
presented. We designed UEP-LDPC codes of length n = 4096 
with nie — 3 protection classes, rate 1/2, and d,;^^_^ = 30 
following the algorithm of |3|. The proportions of the classes 
are chosen such that Ci contains 20% of the information 
bits and C2 contains 80%. The third protection class C3 
contains all parity bits. Therefore, we are mainly interested 
in the performances of classes Ci and C2. The optimized 
variable and check node degree distribution for the UEP- 
LDPC code are given by X{x) = 0.2130x + 0.0927x2 + 
0.2511a;3+0.2521x"+0.0965xi8+0.0946x29 and p{x) = x^, 
respectively. 

In order to have a low-complexity systematic encoder, 
we construct parity check matrices in lower triangular form 
1 11]. This approach also leads to a simplification in our 
optimization procedure, i.e., given that the parity bits are in 
the less protected class C3 and that they should be organized 
in a lower triangular form, we start the optimization from 
the less protected information bits class C2, since all the 
connections between the variable nodes of class C3 and 
the check nodes are completely determined by the lower 



1) Compute X^^^x") 

2) Initialization d^'-^ = 

3) While optimization failure 

a) minimize the average check node degree 
T.'^^Tjf) « ■ Ed:<i,=s Pi^ ™der the 
following constraints, 

C3 :F(A(^■'(x),p(^^a^x,/^^J^O 
Vx G [0, 1) and i / j, 

Ci :Vj' > j and d : d^i < dji < dc^^^ 
p^"*' is fixed. 

"> "■rnin ^ "-rain 

End (While) 



TABLE I 

Local variable degree distributions. The coefficients A^^- 
represent the fraction of edges connected to variables nodes 
of degree i within the class c, . 



Ci 


C2 


C3 


a'^* = 0.00197 
X^s = 0.57263 
A*g' = 0.21085 
A^n' = 0.21455 


a'^' = 0.23982 
Af ' = 0.76018 


A^^' = 0.93901 
Af ' = 0.06099 



TABLE II 

Optimized check node profile for 3 protection classes . The 

COEFFICIENTS p^''' REPRESENT p{/' WITH D : dj = S. 





Ci 


C2 


Cs 


12) 

maxp^ = 0.35 


p^^' = 0.08977 
p^J-'> = 0.19637 
py^ = 0.34911 
py-^ = 0.36475 


p^^' = 0.35 
p*^' = 0.35 
pf ' = 0.30 


pf^ = 0.00024 
p^^' = 0.93877 
p^^' = 0.06099 


(2) 

maxp^ = 0.55 


p^^^ = 0.25248 
p'^' = 0.54860 
pY'' = 0.19892 


pf = 0.45 
pf = 0.55 


pf = 0.00024 
p^^' = 0.93877 
p^^' = 0.06099 


(2) 

maxp^ =0.75 


p^^* = 0.14027 
p^^' = 0.74809 
pf^ = 0.11164 


pf ' = 0.25 
pf = 0.75 


pf = 0.00024 
p^^' = 0.93877 
pf ' = 0.06099 



triangular form construction algorithm. Table U summarizes 
the classes' variable degree distributions A^^'(x). We applied 
the optimization algorithm for different values of maxp"^^ 
to enable the observation of the varying UEP capabilities of 
the codes. The resulting distributions are summarized in Table 
nil All the simulations were done for a total of 50 decoding 
iterations and the constructed codes were all realized through a 
modification of progressive edge-growth (PEG) lfT2l algorithm 
done in order to ensure that the optimized check node degree 
is realized. 

Figure [3] shows that the difference in the performances of 
the protection classes is reduced as we increase the value 

(2) 

of maxp^ . This is an expected effect, since the greater 

(2) 

maxp\ , the greater is the amount of information that C2 
exchanges with Ci . Obviously, this is expected to enhance the 
performance of C2 while lowering the one of Ci . Furthermore, 
despite the already large number of decoding iterations (50 it- 
erations), the UEP capability is preserved, something regarded 
as infeasible in |3| and not observed in |5| for codes realized 
by means of PEG. 

V. Concluding remarks 

In this paper, we introduced a multi-edge type analysis 
of unequal error protection LDPC codes. By means of such 
an analysis, we derived an optimization algorithm that aims 
at optimizing the connection profile between the protection 
classes within a codeword. This optimization allowed us not 
only to control the differences in the performances of the 
protection classes by means of a single parameter, but also 
to prevent the UEP capability of an LDPC code to vanish 
after a moderate to large number of decoding iterations. 




Fig. 3. Classes bit en'or rate of the optimized multi-edge unequal eiTor 



(2) 



protection LDPC codes for different values of maxp^ 
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